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Introduction 


A meeting  was  held  on  August  5,  2002,  in  San  Diego,  Ca,  during  the  National  Conference  of 
Standards  Laboratories  International  (NCSLI)  Conference  and  Symposium,  to  discuss  Nuclear 
Regulatory  Commission  (NRC)  recognition  of  the  use  of  accredited  commercial  calibration  laboratories 
as  suppliers  of  commercial  grade  calibration  services  to  regulated  utilities.  In  attendance  were: 


Name 
Dick  Pettit 
Clint  Eldridge 
Larry  Nielsen 
Jack  Ferris 
John  Ragsdale 
Roxanne  Robinson 

Tony  Anderson 
Mary  Saunders 

Doug  Faison 


Affiliation 

Sandia  National  Laboratories 
Pacific  Gas  & Electric 
Southern  California  Edison 
Sleeping  Bear  Metrology 
Tennessee  Valley  Authority  (TVA) 

American  Association  for  Laboratory  Accreditation  (A2LA) 

(National  Cooperation  for  Laboratory  Accreditation  (NACLA)  President) 
Guildline  Instruments  (NACLA  Board  member) 

National  Institute  of  Standards  and  Technology  (NIST) 

(NIST  representative  to  NACLA  Board) 

NIST/National  Voluntary  Laboratory  Accreditation  Program  (NVLAP) 


The  purpose  of  the  meeting  was  to  map  out  a strategy  for  approaching  the  NRC  concerning  the  issue  of 
calibration  laboratory  accreditation  and  the  National  Cooperation  for  Laboratory  Accreditation 
(NACLA).  The  intent  is  to  gain  NRC  endorsement  of  laboratory  accreditation  based  on  internationally 
accepted  standards  as  a means  of  qualifying  calibration  service  providers  as  suppliers  to  nuclear  power 
facilities. 


One  of  the  group’s  defined  tasks  was  to  develop  a gap  analysis  between  the  internationally  accepted 
requirements  for  laboratory  accreditation  and  NRC  requirements.  Copies  of  several  NRC  documents 
were  obtained  and,  after  a review  of  those  documents,  and  on  the  advice  of  industry  experts,  it  was 
decided  that  the  comparison  should  be  conducted  using  the  audit  requirements  of  the  Nuclear  Utilities 
Procurement  Issues  Committee  (NUPIC),  which  most  accurately  reflect  the  requirements  of  10CFR50, 
Appendix  B,  Quality  Assurance  Criteria  for  Nuclear  Power  Plants  and  Fuel  Reprocessing  Plants. 


This  document  is,  therefore,  a comparison  of  NRC  requirements,  as  defined  by  the  NUPIC 
Commercial  Grade  Survey  Checklist  for  Calibration  Services,  with  the  internationally  accepted 
requirements  for  laboratory  accreditation,  contained  in  ISO/IEC  17025:1999,  General  requirements 
for  the  competence  of  testing  and  calibration  laboratories.  This  document  does  not  specifically 
discuss  the  process  of  laboratory  accreditation  and/or  the  process  of  peer  evaluations  of  laboratory 
accreditation  bodies  for  the  purpose  of  mutual  recognition.  The  left  column  gives  the  verbatim  text 


r m t imp  r^u  *u  „ „ — * — „ .u  ~ i * + — *.  i c 

liuni  uic  ixuriL  uic  ucmti  uuiuiiui  uic  icicvam  iual  num  1 ikjz — >. 


anu  uic  ligm  v^uiuiini 


provides  commentary  on  the  comparison  between  the  two. 


NISTIR  6989 


l 


May  2003 


Basis  for  the  Comparison 


The  NUPIC  Checklist  is  a set  of  18  Methods  of  Verification  spread  over  fourteen  Sections  of  the 
checklist  as  follows: 


Section  I - Training/Qualifications 

Section  II  - Calibration  System  Description 

Section  III  - Contract  Requirements 

Section  IV  - Adequacy  of  Measurement  Standards 

Section  V - Calibration  Procedures 

Section  VI  - Environmental  Controls 

Section  VII  - Intervals  of  Calibration 


Section  VIII  - Calibration  Status 

Section  IX  - Calibration  Traceability 

Section  X - Subcontractor  Calibration 

Section  XI  - Storage  and  Handling 

Section  XII  - Out  of  Tolerance/Corrective  Action 

Section  XIII  - Calibration  System  Adequacy 

Section  XIV  - Records 


The  language  of  the  Methods  of  Verification  appears  to  be  taken  from,  or  is  at  least  very  similar  to,  the 
requirements  of  ANSI/NCSL  Z540-1-1994,  the  American  National  Standard  for  Calibration  - 
Calibration  Laboratories  and  Measuring  and  Test  Equipment  - General  Requirements.  For  each 
of  the  18  Methods  of  Verification,  there  is  reference  to  the  relevant  Z540  requirements  section  or 
clause(s). 

For  comparison  purposes,  only  sections  4 and  5 of  17025  are  relevant  since  Sections  1 through  3 
contain  the  Scope  of  the  Standard,  References,  and  Definitions,  but  no  requirements.  However, 
clauses  1.1  and  1.2  of  the  Scope  provide  useful  guidance  as  to  the  applicability  of  the  standard  as 
follows: 

17025  clause  1.1  “This  International  Standard  specifies  the  general  requirements  for  the 

competence  to  carry  out  tests  and/or  calibrations,  including  sampling.  It  covers 
testing  and  calibration  performed  using  standard  methods,  non-standard 
methods,  and  laboratory-developed  methods.” 

17025  clause  1.2  “This  International  Standard  is  applicable  to  all  organizations  performing  tests 

and/or  calibrations.  These  include,  for  example,  first-,  second-  and  third-party 
laboratories,  and  laboratories  where  testing  and/or  calibration  forms  part  of 
inspection  and  product  certification.” 

Based  on  the  way  the  NUPIC  Methods  of  Verification  are  expressed,  it  is  difficult  in  some  cases  to 
determine  what  would  be  considered  as  acceptable  compliance.  Without  further  guidance,  compliance 
may  be  subject  to  the  interpretation  of  the  requirements  by  individual  auditors.  As  can  be  seen  in  the 
comparison,  ISO/IEC  17025,  as  implemented  through  the  process  of  laboratory  accreditation,  is  very 
specific  concerning  compliance  to  the  standard. 

As  previously  stated,  the  focus  of  this  effort  is  on  gaining  NRC  acceptance  of  accredited  laboratories  as 
suppliers  of  commercial  grade  calibration  services  only.  Thus,  the  requirements  of  10CFR21; 

Nuclear  Regulatory  Commission,  Reporting  of  Defects  and  Noncompliance,  are  not  relevant  to  this 
comparison. 
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Conclusions 


In  the  final  analysis,  the  comparison  shows  that  17025  adequately  addresses  all  but  two  administrative 
issues,  namely: 

1.  NUPIC  clause  14.1.C.7  “The  calibration  certificate/report  shall  include  identification  of  the 

laboratory  equipment/standards  used.”  17025  does  not  require  this, 
but  does  require  that  records  be  kept. 

2.  NUPIC  clause  14.1.C.12  “The  calibration  certificate/report  shall  include  as-found  and  as-left 

data.”  17025  only  requires  as-found  data  to  be  reported  when  the 
device  under  test  is  adjusted/repaired. 

One  additional  issue  requires  explanation.  Clause  4.1  of  the  NUPIC  checklist  states,  in  part,  “Well 
defined  and  documented  measurement  assurance  techniques  or  uncertainty  analyses  may  be  used  to 
verify  the  adequacy  of  the  measurement  process.  If  such  techniques  are  not  used,  the  collective 
uncertainty  of  the  measurement  standards  shall  not  exceed  25  % of  the  acceptable  tolerance  for  each 
characteristic  being  calibrated.”  This  is  typically  referred  to  as  the  four-to-one  ratio.  The  NUPIC 
Checklist  does  not  specifically  require  the  four-to-one  ratio  but  does  allow  its  use  if  an  uncertainty 
analysis  is  not  available.  17025  requires  an  uncertainty  analysis  to  support  all  measurement  results, 
therefore  the  four-to-one  ratio  rule  is  not  applicable. 

However,  clause  12.6  of  Standard  Review  Plan  (SRP)  Section  17.1,  Quality  Assurance  During  the 
Design  and  Construction  Phases  Review  Responsibilities,  states  “Calibration  of  this  equipment 
should  be  against  standards  that  have  an  accuracy  of  at  least  four  times  the  required  accuracy  of  the 
equipment  being  calibrated  or,  when  this  is  not  possible,  have  an  accuracy  that  assures  the  equipment 
being  calibrated  will  be  within  required  tolerance  and  that  the  basis  of  acceptance  is  documented  and 
authorized  by  responsible  management.  The  management  authorized  to  perform  this  function  is 
identified.”  Although  the  SRP  is  not  a requirements  document  and  uses  the  term  “should”  instead  of 
“shall”,  the  four-to-one  ratio  has  become  something  of  a default  requirement  and  industry  experts 
believe  this  issue  should  be  considered  in  this  comparison. 

Each  of  the  three  issues  noted  above  can  easily  be  addressed  by  requiring  the  utilities  to  add  language 
to  their  purchase  orders  for  commercial  grade  calibration  services.  For  example,  to  address  the  four- 
to-one  ratio,  the  following  requirement  could  be  added,  “the  collective  expanded  uncertainty  of  the 
measurement  standards  must  not  exceed  25  % of  the  acceptable  tolerance  for  each  characteristic  being 
calibrated."  Adding  this  statement  to  the  purchase  order  would  ensure  that  an  uncertainty  statement  be 
provided,  as  required  by  17025,  and  that  the  four-to-one  ratio  required  by  SRP  17.1  be  maintained  or 
exceeded.  Similar  statements  could  be  added  to  the  purchase  order  to  require  that  standards  used  in  the 
calibration  process  and  all  as-found  and  as-left  data  be  reported  in  the  Calibration  Certificate/Report. 

It  should  also  be  noted  that  17025  contains  many  requirements,  both  management  and  technical,  that 
are  not  addressed  by  the  NUPIC  checklist  and  are  not  included  in  the  comparison.  Laboratories 
accredited  to  17025  have  more  thoroughly  addressed  those  issues  necessary  to  assure  competence, 
capability,  and  traceability  of  measurement  results. 
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